The phrase "fiddle factor" refers to the tendency or likelihood of people to make mistakes or intentionally manipulate things when working with complex systems or processes. It implies a human element that can introduce errors or biases, causing problems or discrepancies.